AMENDMENT TO THE CLAIMS: 



The following listing of the claims replaces all prior claim versions and listings: 

1 . (Previously Presented) A probability density estimation device for an anomalous data 
detection system adapted to detect anomalous data, said probability density estimation device 
configured for a degree of outlier calculation device for sequentially calculating a degree of 
outlier of each data with a data sequence of real vector values as input, said probability density 
estimation device for, while sequentially reading said data sequence, estimating a probability 
distribution of generation of the data in question by using a finite mixture distribution of normal 
distributions, said probability density estimation device comprising: 

probability calculation means for calculating, based on a value of input data and 
values of a mean parameter and a variance parameter of each of a finite number of normal 
distribution densities, a probability of generation of the input data in question from each normal 
distribution; and 

parameter output means for updating and rewriting the stored parameter values 
while forgetting past data, according to newly read data based on a probability obtained by the 
probability calculation means, values of a mean parameter and a variance parameter of each 
normal distribution and a weighting parameter of each normal distribution. 

2. (Previously Presented) The probability density estimation device as set forth in claim 1, 
further comprising: 

parameter storage means for storing values of a mean parameter and a variance 
parameter of each of a finite number of normal distribution densities and a weighting parameter 
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of each normal distribution, wherein said parameter rewriting means updates and rewrites data of 
said parameter storage means. 



3. (Previously Presented) A degree of outlier calculation device for sequentially calculating a 
degree of outlier of each data with a data sequence of real vector values as input, said degree of 
outlier calculation device adapted to detect anomalous data, and comprising: 

a probability density estimation device for, while sequentially reading said data 
sequence, estimating a probability distribution of generation of the data in question by using a 
finite mixture of normal distributions, said probability density estimation device including: 

(a) parameter storage means for storing values of a mean parameter and a 
variance parameter of each of a finite number of normal distribution densities and a weighting 
parameter of each normal distribution; 

(b) probability calculation means for calculating, based on a value of input 
data and values of a mean parameter and a variance parameter of each of a finite number of 
normal distribution densities, a probability of generation of the input data in question from each 
normal distribution; and 

(c) parameter rewriting means for updating and rewriting the stored parameter 
values while forgetting past data, according to newly read data based on a probability obtained 
by the probability calculation means, values of a mean parameter and a variance parameter of 
each normal distribution and a weighting parameter of each normal distribution;, and 

degree of outlier calculation means for calculating and outputting a degree of 
outlier of said data by using a parameter of the normal mixture updated by said probability 
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density estimation device and based on a probability distribution estimated from values of the 
parameters before and after the updating and the input data. 

4-5. Cancel 

6. (Previously Presented) A histogram calculation device for a degree of outlier calculation 
device for sequentiall y calculating a degree of outlier of each data with discrete value data as 
input, said degree of outlier calculation device useful for anomalous data detection, histogram 
calculation device for calculating a parameter of a histogram with respect to said discrete value 
data sequentially input, said histogram calculation device comprising: 

storage means for storing a parameter value of said histogram; and 
parameter updating means for reading said parameter value from the storage 
means and updating past parameter values while forgetting past data based on input data to 
rewrite the value of said storage means, thereby outputting some of parameter values of said 
storage means. 

7. (Previously Presented) A degree of outlier calculation device for sequentially calculating 
a degree of outlier of each data with discrete value data as input, said degree of outlier 
calculation device useful for anomalous data detection, and comprising: 

a histogram calculation device for calculating a parameter of a histogram with 
respect to said discrete value data sequentially input, said histogram calculation device including: 
storage means for storing a parameter value of said histogram; and 
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parameter updating means for reading said parameter value from the storage 
means and updating past parameter values while forgetting past data based on input data to 
rewrite the value of said storage means, thereby outputting some of parameter values of said 
storage means; and 

score calculation means for calculating, based on the output of the histogram 
calculation device and said input data, a score of the input data in question with respect to said 
histogram, thereby outputting the output of the score calculation means as a degree of outlier of 
said input data. 

8. (Previously Presented) A degree of outlier calculation device for calculating a degree of 
outlier with respect to sequentially input data which is described both in a discrete value and a 
continuous value, said degree of outlier calculation device useful for anomalous data detection, 
and comprising: 

a histogram calculation device for estimating a histogram with respect to a 
discrete value data part; 

a number of probability density estimation devices, the number equal to the 
number of cells of said histogram, the probability density estimation devices for estimating a 
probability density with respect to a continuous value data part; 

cell determination means for determining to which cell of said histogram said 
discrete value data part belongs to send the continuous data part to the corresponding one of said 
probability density estimation devices; and 

score calculation means for calculating a score of said input data based on a 
probability distribution estimated from output values of said histogram calculation device and 
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said probability density estimation device and said input data, thereby outputting the output of 

the score calculation means as a degree of outlier of said input data; 
said histogram calculation device including: 
storage means for storing a parameter value of said histogram; and 
parameter updating means for reading said parameter value from the storage 

means and updating past parameter values while forgetting past data based on input data to 

rewrite the value of said storage means, thereby outputting some of parameter values of said 

storage means; and 

said probability density estimation device including: 

parameter storage means for storing values of a mean parameter and a variance 
parameter of each of a finite number of normal distribution densities and a weighting parameter 
of each normal distribution; 

probability calculation means for calculating, based on a value of input data, and 
values of a mean parameter and a variance parameter of each of a finite number of normal 
distribution densities, a probability of generation of the input data in question from each normal 
distribution; and 

parameter rewriting means for updating and rewriting the stored parameter values 
while forgetting past data, according to newly read data based on a probability obtained by the 
probability calculation means, values of a mean parameter and a variance parameter of each 
normal distribution and a weighting parameter of each normal distribution. 

9. (Previously Presented) A degree of outlier calculation device for calculating a degree of 
outlier with respect to sequentially input data which is described both in a discrete value and a 
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continuous value, said degree of outlier calculation device useful for anomalous data detection, 
and comprising: 

a histogram calculation device for estimating a histogram with respect to said 
discrete value data part; 

a number of probability density estimation devices, the number equal to the 
number of cells of said histogram for estimating a probability density with respect to a 
continuous value data part; 

cell determination means for determining to which cell of the histogram said 
discrete value data part belongs to send the continuous data part to the corresponding one of said 
probability density estimation devices; and 

score calculation means for calculating a score of said input data based on a 
probability distribution estimated from output values of said histogram calculation device and 
said probability density estimation device and said input data, thereby outputting the output of 
the score calculation means as a degree of outlier of said input data; 

said histogram calculation device including: 

storage means for storing a parameter value of said histogram; and 

parameter updating means for reading said parameter value from the storage 
means and updating past parameter values while forgetting past data based on input data to 
rewrite the value of said storage means, thereby outputting some of parameter values of said 
storage means; and 

said probability density estimation device including: 

parameter storage means for storing a value of a parameter indicative of a position 
of each kernel; and 
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parameter rewriting means for reading a value of a parameter from the storage 
means and updating the stored parameter values while forgetting past data, according to newly 
read data to rewrite the contents of the parameter storage means. 



10. (Currently Amended) A probability density estimation method for a degree of outlier 
calculation device of a data processor for sequentially calculating a degree of outlier of each data 
with a data sequence of real vector values as input, said degree of outlier calculation device 
useful for anomalous data detection, said probability density estimation method of, while 
sequentially reading said data sequence, estimating a probability distribution of generation of the 
data in question by using a finite mixture of normal distributions, the method comprising: 

based on values of a mean parameter and a variance parameter of each of a finite 
number of normal distribution densities read from parameter storage means for storing a value of 
input data, values of a mean parameter and a variance parameter of each of a finite number of 
normal distribution densities, and a weighting parameter of each normal distribution, calculating 
a probability of generation of the input data in question from each normal distribution; and 

. v 

updating the stored parameter values while forgetting past data, according to 

***** 

pJV^ * newly read data based on a probability obtained by the probability calculation means, values of a 
mean parameter and a variance parameter of each normal distribution and a weighting parameter 
^C\i)^uA °f eac ^ norm al distribution to rewrite data of said parameter storage means. 
a!^^u^Ox\ &r ooopl^ 

11. (Currently Amended) A computer-readable medium incorporating a program of instructions 
configured to perform a method of sequentially calculating a degree of outlier of each data useful 
for anomalous data detection, with a data sequence of real vector values as input, including a 
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probability density estimation for, while sequentially reading said data sequence, estimating a 
probability distribution of generation of the data in question by using a finite mixture of normal 
distributions, the probability density estimation comprising : 

based on values of a mean parameter and a variance parameter of each of a finite 
number of normal distribution densities read from parameter storage means for storing a value of 
input data, values of a mean parameter and a variance parameter of each of a finite number of 
normal distribution densities, and a weighting parameter of each normal distribution, calculating 
a probability of generation of the input data in question from each normal distribution; and 

updating the stored parameter values while forgetting past data, according to 
newly read data based on a probability obtained by the probability calculation means, values of a 
mean parameter and a variance parameter of each normal distribution and a weighting parameter 
of each normal distribution to rewrite data of said parameter storage means; said method of 
sequentially calculating a degree of outlier of each data further comprising : 

calculating and outputting a degree of outlier of said data by using a parameter of 
the finite mixture distribution updated by said probability density estimation and based on a 
probability distribution estimated from values of the parameters before and after the updating 
and the input data. 

12-13. Cancel 

14. (Currently Amended) A computer-readable medium incorporating a program of instructions 
configured to perform a histogram calculation method for use in calculation of a degree of outlier 
for sequentially calculating a degree of outlier of each data with discrete value data as input, said 
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calculation of the degree of outlier useful for anomalous data detection, said histogram 
calculation method , said histogram calculation m e thod calculating a parameter of a histogram 
with respect to said discrete value data sequentially input, comprising the st e ps of : 

reading said parameter value from storage means for storing a parameter value of 
said histogram and updating past parameter values while forgetting past data based on input data 
to rewrite the value of said storage means; and 

outputting some of parameter values of said storage means. 

1 5. (Currently Amended) A degree of outlier calculation device of a data processor for 
sequentially calculating a degree of outlier of each data with discrete value data as input, said 
degree of outlier calculation device usefiil for detecting anomalous data, and said degree of 
outlier calculation device comprising: 

a histogram calculation device for calculating a parameter of a histogram with 
respect to said discrete value data sequentially input, including: 

storage means for storing a parameter value of said histogram; and 
parameter updating means for reading said parameter value from the storage 
means and updating past parameter values while forgetting past data based on input data to 
rewrite the value of said storage means, thereby outputting some of parameter values of said 
storage means; and 

score calculation means for calculating, based on the output of the histogram 
calculation device and said input data, a score of the input data in question with respect to said 
histogram, thereby outputting the score calculation result as a degree of outlier of said input data. 
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16. (Currently Amended) A degree of outlier calculation method of calculating a degree of 
outlier by a data processor with respect to sequentially input data which is described both in a 
discrete value and a continuous value, calculation of the degree of outlier useful for detection of 
anomalous data, wherein a histogram calculation estimates a histogram with respect to a discrete 
value data part, said method comprising th e st e ps of : 

reading said parameter value from storage means for storing a parameter value of 
said histogram and updating past parameter values while forgetting past data based on input data 
to rewrite the value of said storage means; and 

outputting some of parameter values of said storage means, and wherein 

probability density estimation devices provided as many as the number of cells of 
said histogram for estimating a probability density with respect to a continuous value data part, 
said method comprises the steps of: 

based on values of a mean parameter and a variance parameter of each of a finite 
number of normal distribution densities read from parameter storage means for storing a value of 
input data, values of a mean parameter and variance parameter of each of a finite number of 
normal distribution densities and a weighting parameter of each normal distribution, calculating 
a probability of generation of the input data in question from each normal distribution; 

based on a probability obtained by the probability calculation means, values of a 
mean parameter and a variance parameter of each normal distribution and a weighting parameter 
of each normal distribution, updating the stored parameter values while forgetting past data, 
according to newly read data to rewrite the data of said parameter storage means; determining to 
which cell of said histogram said discrete value data part belongs to send the continuous data part 
to the corresponding one of said probability density estimation devices; 
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calculating a score of said input data based on a probability distribution estimated 
from output values of said histogram calculation device and said probability density estimation 
device and said input data; and 

outputting the score calculation result as a degree of outlier of said input data. 
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